Updates to Teradata Provider #39217
Merged
Updates to Teradata Provider #39217
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
eladkal
reviewed
Apr 27, 2024
Implemented enhancements to the Teradata Provider for Teradata. This release incorporates the following features: • Introduction of Stored Procedure Support in Teradata Hook • Inclusion of the TeradataStoredProcedureOperator for executing stored procedures • Integration of Azure Blob Storage to Teradata Transfer Operator • Integration of Amazon S3 to Teradata Transfer Operator • Provision of necessary documentation, along with unit and system tests, for the Teradata Provider modifications.
|
Reopening due to accidental closure. |
eladkal
reviewed
May 2, 2024
eladkal
reviewed
May 2, 2024
Taragolis
reviewed
May 3, 2024
tests/system/providers/teradata/example_azure_blob_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
tests/system/providers/teradata/example_azure_blob_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
tests/system/providers/teradata/example_s3_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
tests/system/providers/teradata/example_s3_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
tests/system/providers/teradata/example_s3_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
tests/system/providers/teradata/example_s3_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
tests/system/providers/teradata/example_s3_to_teradata_transfer.py
Outdated
Show resolved
Hide resolved
Addressed following PR review comments Azure and Amazon optional dependency in teradata provider.yaml Added another parameter to s3 transfer operator to specify given bucket is public or not Added more examples of stored procedure operator in stored procedure system DAG Changed """ to " for single line SQL statements in system tests DAGs Applied dedent for SQL statements in cloud transfer operators
Taragolis
reviewed
May 16, 2024
* Modified conn_id to teradata_conn_id for Teradata Operator * static check issue fixed
|
Can you also rebase please @satish-chinthanippu ?. We want to make sure all tests pass also with latest main |
eladkal
reviewed
May 28, 2024
rebase done. All tests are pass with latest main. |
|
@Taragolis @eladkal -> I reviewed and resolved all the conversations (they looked like answered/resolved) - will merge this one, byt if you have other comments possibly those can be done as a follow-up. |
20 tasks
fdemiane
pushed a commit
to fdemiane/airflow
that referenced
this pull request
Jun 6, 2024
* Updates to Teradata Provider with release 2.2.0 Implemented enhancements to the Teradata Provider for Teradata. This release incorporates the following features: • Introduction of Stored Procedure Support in Teradata Hook • Inclusion of the TeradataStoredProcedureOperator for executing stored procedures • Integration of Azure Blob Storage to Teradata Transfer Operator • Integration of Amazon S3 to Teradata Transfer Operator • Provision of necessary documentation, along with unit and system tests, for the Teradata Provider modifications. Azure and Amazon optional dependency in teradata provider.yaml Added another parameter to s3 transfer operator to specify given bucket is public or not Added more examples of stored procedure operator in stored procedure system DAG Changed """ to " for single line SQL statements in system tests DAGs Applied dedent for SQL statements in cloud transfer operators
jannisko
pushed a commit
to jannisko/airflow
that referenced
this pull request
Jun 15, 2024
* Updates to Teradata Provider with release 2.2.0 Implemented enhancements to the Teradata Provider for Teradata. This release incorporates the following features: • Introduction of Stored Procedure Support in Teradata Hook • Inclusion of the TeradataStoredProcedureOperator for executing stored procedures • Integration of Azure Blob Storage to Teradata Transfer Operator • Integration of Amazon S3 to Teradata Transfer Operator • Provision of necessary documentation, along with unit and system tests, for the Teradata Provider modifications. Azure and Amazon optional dependency in teradata provider.yaml Added another parameter to s3 transfer operator to specify given bucket is public or not Added more examples of stored procedure operator in stored procedure system DAG Changed """ to " for single line SQL statements in system tests DAGs Applied dedent for SQL statements in cloud transfer operators
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Implemented enhancements to the Teradata Provider for Teradata.
This release incorporates the following features:
• Introduction of Stored Procedure Support in Teradata Hook
• Inclusion of the TeradataStoredProcedureOperator for executing stored procedures
• Integration of Azure Blob Storage to Teradata Transfer Operator
• Integration of Amazon S3 to Teradata Transfer Operator
• Provision of necessary documentation, along with unit and system tests, for the Teradata Provider modifications.
Teradata Provider System Health Dashboard: https://teradata.github.io/airflow/
Teradata Provider documentation build status: https://github.com/Teradata/airflow/actions/workflows/ci-teradata-documentation.yml
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rstor{issue_number}.significant.rst, in newsfragments.